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Abstract — In this paper we propose a very simple but powerful 
self -correction method for the Min-Sum decoding of LPDC codes. 
Unlike other correction methods known in the literature, our 
method does not try to correct the check node processing approx- 
imation, but it modifies the variable node processing by erasing 
unreliable messages. However, this positively affects check node 
messages, which become symmetric Gaussian distributed, and 
we show that this is sufficient to ensure quasi-optimal decoding 
performance. Monte-Carlo simulations show that the proposed 
Self-Corrected Min-Sum decoding performs very close to the 
Sum-Product decoding, while preserving the main features of 
the Min-Sum decoding, that is low complexity and independence 
with respect to noise variance estimation errors. 

Index Terms — LDPC codes, graph codes, Min-Sum decoding. 



I. Introduction 

Low density parity check (LDPC) codes can be itera- 
tively decoded using message-passing type algorithms that 
may be classified as optimal, sub-optimal or quasi-optimal. 
The optimal iterative decoding is performed by the Sum- 
Product algorithm [6] at the price of an increased complexity, 
computation instability, and dependence on thermal noise 
estimation errors. The Min-Sum algorithm [6] performs a sub- 
optimal iterative decoding, less complex than the Sum-Product 
decoding, and independent of thermal noise estimation errors. 
The sub-optimality of the Min-Sum decoding comes from 
the overestimation of check-node messages, which leads to 
performance loss with respect to the Sum-Product decoding. 
However, as we will highlight in this paper, it is not the 
overestimation by itself, which causes the Min-Sum sub- 
optimality, but rather the loss of the symmetric Gaussian 
distribution of check-node messages. 

Several correction methods were proposed in the literature 
in order to recover the performance loss of the Min-Sum 
decoding with respect to the Sum-Product decoding. We call 
such algorithms quasi-optimal. Ideally, a quasi-optimal algo- 
rithm should perform very close to the Sum-Product decoding, 
while preserving the main features of the Min-Sum decoding, 
that is low complexity and independence with respect to 
noise variance estimation errors. The most popular correction 
methods are the Normalized Min-Sum and the Offset Min- 
Sum algorithms [1]. These algorithms share the idea that the 
performance loss can be recovered by reducing the amplitudes 
of check-node messages, which is desirable as these messages 
are actually overestimated within the Min-Sum decoding. 

In [5] we showed that the performance loss of the Min-Sum 
decoding can be recovered by "cleaning" the computation trees 
associated with the decoding process. While this was the first 
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example of a self-correction method of the Min-Sum decoding, 
the drawback is that it requires a different processing order of 
nodes at each iteration, which may be hardly implementable 
in hardware. 

The starting point of this paper was to figure out how to 
benefit from the idea of "cleaning" computation trees without 
requiring any particulary processing order of nodes. The 
proposed Self-Corrected Min-Sum decoding detects unreliable 
information simply by the sign fluctuation of variable node 
messages. Precisely, any variable node message changing its 
sign between two consecutive iterations is erased, meaning 
that any such a fluctuating message is set to zero. The Self- 
Corrected Min-Sum decoding will be analyzed from two 
different but complementary points of view. They can be 
summarized as follows: 

• Erasing fluctuating messages may be seen as cleaning com- 
putation trees associated with the decoding process of some 
unreliable information. We will show that the Self-Corrected 
Min-Sum decoding behaves as the Min-Sum decoding applied 
on a sub-tree of unerased messages. 

• We also show that the check node messages exchanged 
within the Self-Corrected Min-Sum decoding have a symme- 
tric Gaussian distribution, and that this is sufficient to ensure 
quasi-optimal decoding performance. 

The paper is organized as follows. In the next section we 
introduce and explain the Self-Corrected Min-Sum algorithm. 
In section [III] we study computation trees associated with 
the decoding process, and describe the behavior of the Self- 
Corrected Min-Sum decoding on graph with cycles. In section 
llVl we show that check node messages have a symmetric 
Gaussian distribution and we discuss the analysis of the Self- 
Corrected Min-Sum decoding by Gaussian approximation. 
Finally, section [V] presents simulation results and section [VI] 
concludes this paper. 

The following notations concern bipartite graphs and 
message-passing algorithms running on these graphs, and will 
be used throughout the paper. 

• H, the Tanner graph of a LDPC code, comprising N 
variable nodes and M check nodes, 

• n £ {1,2,..., N}, a variable node of Ti, 

• m £ {1, 2, . . . , M}, a check node of Ti, 

• H(n), set of neighbor check nodes of the variable node n, 

• Ti(m), set of neighbor variable nodes of the check node m, 

• 7„, a priori information (LLR) of the variable node n, 

• 7n, a posteriori information (LLR) of the variable node n, 

• a m . n , the variable-to-check message from n to m, 

• Pm, 71, the check-to-variable message from m to n. 
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II. Self-Corrected Min-Sum decoding 

The Self-Corrected Min-Sum decoding performs the same 
initialization step, check node processing, and a posteriori 
information update as the classical Min-Sum decoding. The 
variable node processing is modified as shown below: 

Initialization 

• A priori information 

7n(o) = ln(Pr(a;n = | channel)/Pr(.T„ = 1 | channel)) 

• Variable-to-check messages initialization 

Iterations 

• Check node processing 

P m ,n = TT sgn(a m) „<) • min (| a mn > |) 

\ \\s a / »'eW m)\{n} 

\n' EH{m)\{n' } / 

• A posteriori information 

mGH(n) 

• Variable node processing 

if sgn«; p „) = sgn(a m , n ) f/zen a m , n = a^ n 
else a„ l: n = 
The variable node processing is explained below: 

• First, we compute the new extrinsic LLR for the current 
iteration by a™ p n = 7„ — (3 m ,n- However, unlike the classical 
Min-Sum decoding, this value is stored as an intermediary 
(temporary) value. We note that at this moment the message 
dm,n still contains the value of the previous iteration. 

• Next, we compare the signs of the temporary a™ p „ (extrinsic 
LLR computed at the current iteration) and the message a m , n 
that was sent by the variable node n to the check node m at 
the previous iteration. If the two signs are equal we update the 
variable node message by ot m ,n — a mn an d senc ' tn i s va l ue 
to the check node m. 

• On the other hand, if the two signs are different, the variable 
node n send an erasure to the check node m, meaning that 
the variable node message a m , n lS set to zero. 

It should be noted that we consider the zero message to have 
both negative and positive signs. In other words, whenever 
the old message a rn . n — 0, we update the new variable node 
message by a m ,n = cC P „. 

Fig- 03 presents the percentage of sign changes for each 
decoding iteration. Obviously, this percentage tends to zero in 
case of successful decoding. The dotted curves, corresponding 
to successful decoding, indicate that the Self-Corrected Min- 
Sum decoder converges faster than the Min-Sum decoder. In 
case of unsuccessful decoding, it can be observed that the 
percentage of sign changes tends very quickly to a positive 
value. At the first iteration both Min-Sum and Self-Corrected 
Min-Sum decodings present the same percentage of sign 
changes, since in both cases variable-to-check messages are 
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Fig. 1. Percentage of sign changes per iteration: AWGN, coding rate 1/2, 
E b /No = ldB, maximum iteration number = 200 



initialized from the same a priori information. Nonetheless, 
they behave in a completely different way during the first 
iterations: the percentage of sign changes increases in case 
of Min-Sum decoding, while it decreases within the Self- 
Corrected Min-Sum decoding. Thus, one consequence of the 
self-correction method is to control sign fluctuations when they 
occur, which help the decoder to enter into a convergence 
mode. 

III. Computation trees 

Computation trees proved to be very useful in understanding 
the behavior of message-passing decoders running on graphs 
with cycles [6]. Consider some information iteratively com- 
puted at some variable node n. By examining the updates that 
have occurred, one may recursively trace back through time the 
computation of this information. This trace back will form a 
tree graph rooted at n and consisting of interconnected variable 
and check nodes in the same way as in the original graph, but 
the same variable or check nodes may appear at several places 



in the tree. We denote by Tn and Am, n the computation trees 
of 7„ and a m , n at the I th iteration. Both trees are rooted at n, 
the difference is that T$ does contain a copy of m as child 
node of n, while Am, n does not. Moreover, we note that these 
computation trees do not depend on the decoding algorithm, 
but only on the Tanner graph and the iteration number. 

Let T be an arbitrary bipartite tree of deptrQ L, whose root 
and leaf nodes are all variable nodes. If Dec is a message- 
passing decoder running on T, we denote by Dec(T) the a 
posteriori information of the root node of T at the L th iteration. 

Example 1: Let MS and SCMS denote the Min-Sum 
and Self-Corrected Min-Sum decoders respectively. Then 
MS(Am,n) and SCMS(Am, n ) are equal to the variable node 
messages a m .„ computed by the Min-Sum and Self-Corrected 
Min-Sum algorithms respectively, at the I th iteration. 

Proposition 2: For any nodes n, m and any iteration I, there 
exists a sub-tree Tm,n C Am, n containing n such that: 



scms(^j = ms(t; 



(0 ^ 

rn , n J 



'The depth of a variable node is defined recursively from root to leaf nodes: 
the root node is of depth zero and the depth of any other variable node is one 
plus the depth of its grandparent variable node. The depth of the tree is the 
maximum depth of its variable nodes. 
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Fig. 2. Computation tree (part of) 

The same holds for the a posteriori information tree T n . 

Indeed, assume that TL(n) — {m, mi, . . . , m.j}, and let 
Am,n be the computation tree represented in Fig. [2] If none 
of the messages from variable nodes n\, . . . , rij to the parent 
check node mi has been erased at iteration I — 1, then the 
processing of rii, . . . , rij and mj corresponds to classical Min- 
Sum updates. On the contrary, assume that at iteration I — 1, 
the message sent by the variable node n\ to its parent check 
node mi has been set to zero. Then, at iteration I, the check 
node message sent by the check node mi to its parent variable 
node n is also equal to zero. Therefore, we can omit this 
message when processing the variable node n, or equivalently, 
the sub-tree Hi corresponding to the check node mi can be 
discarded. The proposition is proved by moving down the tree 
and applying the above arguments recursively. 

From a more intuitive perspective, the above proposition 
states that the Self-Corrected Min-Sum decoding behaves as 
the Min-Sum decoding applied on the sub-tree of unerased 
messages. 

IV. Analysis of the Self-Corrected Min-Sum 

DECODING USING GAUSSIAN APPROXIMATION 

Throughout this section we restrict ourselves to the AWGN 
channel with noise variance a 2 , and we consider the BPSK 
modulation mapping bit i — ^ +1 and bit 1 i— > — 1. Without loss 
of generality, we further assume that the all-zero codeword is 
sent over the channel. At the receiver side, a message-passing 
algorithm is used to decode the received signal. Let P\ be 
the decoding error probability at iteration I. Therefore, P\ is 
simply the average probability that variable node messages are 
non-positive: 

P l e = Pr«„ < 0) 

where superscript I is used (and will be used from now on) 
to denote messages sent at the I th iteration. We note that 
the probability Pr(or m n = 0) is zero for the Sum-Product 
or the Min-Sum decoding, but this is not the case anymore 
for the Self-Corrected Min-Sum decoding. The Gaussian ap- 
proximation is an approach to track the error probability of a 
message-passing decoding, based on Gaussian densities. The 
following conditions are needed for the analysis by Gaussian 
approximation: 

(GD) Gaussian distribution condition: messages received at 
every node at every iteration are independent and identically 



distributed (i.i.d), with symmetric Gaussian distribution of the 
form: 

1 (x- m ) 2 

V47rm 

where the parameter m is the mean. 

We will denote by mo = 2/rr 2 the mean of the a priori 
information, and by m l a and m l a the means of variable and 
check node messages at iteration 1, respectively. 

(CNP) Check node processing condition: 

^(/^n) = II S S n ( a 'm,n') 

n'eH(rn)\{n'} 

(VNP) Variable node processing condition: 

a m,n = 7" + Pm' ,n 

m'eH(n)\{m) 

The irregularity of the LDPC code is specified as usual, 
using variable and check node distribution degree polynomials: 
^( x ) = 12i=2 ^i 2 ^ -1 ' where d v is the maximum variable node 
degree and is the fraction of edges connected to variable 
nodes of degree i, respectively p(x) = Ylj=2Pj x ''~ 1 < where 
d c is the maximum check node degree and pj id the fraction 
of edges connected to check nodes of degree i 

Theorem 3: Let ip be the function defined by: 

where Q(x) = / e 2 dt. Then tp depends only on 

V 27T Jx 

a, A, and p, and for any message-passing decoder satisfying 
the conditions (DG), (CNP), and (VNP), the following recur- 
rence relation holds: 

The main consequence of this theorem is that the exact 
check node processing is not really important. It is only im- 
portant that check node messages have a symmetric Gaussian 
distribution and their signs verify the (CNP) condition. The 
proof can be derived similarly as in [4], noting that only the 
conditions (DG), (CNP) and (VNP) are needed, not the Sum- 
Product decoder assumption by itself. 

Conditions (CNP) and (VNP) are verified by both Sum- 
Product and Min-Sum decoders. The performance gap between 
these decoders is explained by the fact that the Min-Sum 
fails to satisfy the Gaussian distribution (GD) condition for 
check node messages. This can be seen in Fig. [3] (a) and 
(b) that represent the empirical probability densities of check 
node messages computed by the Sum-Product and the Min- 
Sum decoders. A straightforward consequence of the above 
theorem is that if the check node messages of the Min-Sum 
decoder would have a Gaussian-like distribution, then the Min- 
Sum and the Sum-Product decoders would exhibit the same 
performance. 

In Fig. |3] (c), it can be seen that the empirical probability 
density of check nodes messages exchanged by the Self- 
Corrected Min-Sum decoding is very close to the Gaussian 
density of the (GD) condition. For the empirical probability 
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(a) Sum-Product decoding (6) Min-Sum decoding 

Fig. 3. Empirical probability density vs. Gaussian density after 20 iterations (Ei,/Nq = 1.5 dB) 



(c) Self-Corrected Min-Sum decoding 



density we taken into account only unerased (i.e. non zero) 
check node messages. As discussed in the above section, the 
Self-Corrected Min-Sum decoding behaves as the Min-Sum 
decoding applied on unerased messages. It follows that the 
Self-Corrected Min-Sum decoding satisfies the three condi- 
tions (DG), (CNP) and (VNP) and therefore there should 
be no gap between its performance and the Sum-Product 
decoding performance. However, we should be careful about 
this assertion, because the recurrence relation of the error 
probability of the Self-Corrected Min-Sum decoding should be 
slightly different from the one of the Sum-Product decoding. 
In fact, if we see the Self-Corrected Min-Sum as the Min- 
Sum decoding applied on unerased messages, then the variable 
node degrees may vary from one iteration to another and this 
depends on the erasure probability. For instance, in Fig. [2] if 
a = ami.rii is erased at some iteration, then the sub-tree Hi 
is discarded and the degree of the variable node n decreases 
by one. 

So far we have given a rather intuitive explanation of the 
observed behavior. In order to write it formally, we need to 
split the error probability as P\ = P l + E l , where P l = 
Pr(o4 „ < 0) and E l = Pr(a l mn = 0). The second 
probability is called the erasure probability at iteration I. 
We also note R l e = Pr(f3 l m „ < 0) = R l + F l , where 
R l = Pr(/3^ „ < 0) and R l = Pr(/4 „ = 0). The joint 
recurrence relation of (P ,E) is derived in several steps as 
follows. 

1) A check node message /3„ ^ is erased if and only if there 
exists an erased incoming variable node messages a l m n , = 0. 
Since this happens with probability (1— £r ) J_1 , where j is the 
degree of the check node to, and averaging over all possible 
check node degrees, we get: 

F^ = jr Pj (i-(i-E l y-i) 

= 1 - P(l - E l ) 

2) A check node message < if and only if all 
incoming variable node messages a l rn , are not erased, and if 
the number of incoming negative messages is odd. Using [2], 



lemma 4.1, we get: 

= \(p(l-E')-p(l-E , -2P')) 

On the other hand, at iteration / + 1, check node messages 
have a symmetric Gaussian distribution with mean nip. It 
follows that: 

3) At iteration I + 1, the temporary extrinsic LLR a™ p n is the 
sum of the a priori information 7„ and the unerased incoming 
check node messages ^ 0. If the variable node n is of 
degree i, the expected number of not erased incoming check 
node messages is (1 — F l+1 )(i — 1) = p(l — E l )(i — 1). Then 
the expectation of a!°\ p n is too + p(l — E l )(i — l)TOjg +1 and it 
follows that: 

/ / too + p(l - E l )(i - 1)to' +1 \ 
Pr«„ < 0) = Q N ^ ^ > -B-\ 

For convenience, we denote the above probability by Q\ +1 . 
Furthermore, since the variable node message a 1 ^^ < iff 
(*m n — aR d &m,n < 0' an ^ averaging over all possible 
variable node degrees, we get: 

pl+i = plJ- x . Q l+i 

4) With the above notation, the variable node message a l ^\ 
is erased if and only if a l m n < and a™ p „ > 0, or a l mn > 
and a^ p „ < 0. Consequently, we obtain: 

E i+i = p i {1 _ J- XiQ 1 ^ 1 ) + (1 - Pi) £ A 4 Q< +1 

Moreover, we note that the following equality holds: 
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For convenience, we introduce the following notation: 

u( \ p(i - y) - p(i - V ~ 2 %) 
R(x,y) = o 



i(x,y) = Q 



1 



+ p(l-y)(t-l)Q-HR(x,y)) 



Theorem 4: Let cf> — (<fii, fo), where: 

<i>i{x,y) = {x + y)^X l Q l {x,y) 

d v 

(/>2(x,y) = x+ (1 - y - 2x)^2\iQi(x,y) 

i=2 

Then the following recurrence relation holds: 

{P l+1 ,E l+1 ) = (p{P l ,E l ) 

V. Simulation results 

We present Monte-Carlo simulation results for coding rate 
1/2 over the AWGN channel with QPSK modulation. 

Floating-point performance of optimized irregular LDPC 
codes under the Sum-Product, Min-Sum, Self-Corrected Min- 
Sum, and Normalized Min-Sum decoders is presented in Fig. [4] 
and Fig. [5] in terms of bit and frame error rates, respectively. 
We note that the performance gap between the Self-Corrected 
Min-Sum and the Sum-Product decoders is only of 0.05 dB 
for short code lengths (2304 bits) and of 0.1 dB for long code 
lengths (8064 bits). Moreover, in case of short code lengths 
the Self-Corrected Min-Sum decoder outperforms the Sum- 
Product decoder at high SNR values, corresponding to the 
error floor of the second decoder. Concerning the Normalized 
Min-Sum decoder, its bit error rate performance is very close 
to the one of the Self-Corrected Min-Sum decoder at low 
SNR values; however, it presents an error floor at higher SNR 
values. Furthermore, it behaves completely faulty in terms of 
frame error rate, which is quite surprising as this does not fit 
with the bit error rate behavior. 

Fig [6] presents fixed point simulation results for the quasi- 
cyclic LDPC codes of length 2304 bits from the IEEE-802.16e 
standard [3]. The above conclusions also apply in this case. 
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Fig. 4. Irregular LDPC codes, floating point simulation, Bit Error Rate, max 
iter number = 200 
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Fig. 5. Irregular LDPC codes, floating point simulation, Frame Error Rate, 
max iter number = 200 
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IEEE-802.16e LDPC codes, fixed point simulation (-8 < 7, a, f3 < 
32 < 7 < 32, with quantization step 0.25), max iter number = 30 



VI. Conclusions 

A very simple but powerful self-correction method for the 
Min-Sum decoding of LDPC codes was presented in this 
paper. The proposed Self-Corrected Min-Sum algorithm per- 
forms quasi-optimal iterative decoding, while preserving low 
Min-Sum complexity and independence with respect to noise 
variance estimation errors. This makes the Self-Corrected Min- 
Sum decoding very attractive for practical purposes. 
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